Stabilization of a delayed quantum system: 
the photon box case-study* 

CSl ] Hadis Amini ^ Mazyar Mirrahimi-'- Pierre Rouchon^ 

> 

O 

o 



^ 



^ 



Abstract 



We study a feedback scheme to stabilize an arbitrary photon number state in a mi- 
crowave cavity. The quantum non-demolition measurement of the cavity state allows a 
\^ • non-deterministic preparation of Fock states. Here, by the mean of a controlled field 

^^ , injection, we desire to make this preparation process deterministic. The system evolves 

through a discrete-time Markov process and we design the feedback law applying Lya- 
punov techniques. Also, in our feedback design we take into account an unavoidable pure 
2 ' delay and we compensate it by a stochastic version of a Smith predictor. After illustrat- 

ing the efficiency of the proposed feedback law through simulations, we provide a rigorous 
proof of the global stability of the closed-loop system based on tools from stochastic sta- 
p^ , bility analysis. A brief study of the Lyapunov exponents of the linearized system around 

^ ' the target state gives a strong indication of the robustness of the method. 

00 

^^ ■ 1 Introduction 

en 

r^ I In the aim of achieving a robust processing of quantum information, one of the main tasks is 

(<— ^ ' to prepare and to protect various quantum states. Through the last 15 years, the application 

of quantum feedback paradigms has been investigated by many physicists [21, 19, 5, 10, 16] 
as a possible solution for this robust preparation. However, most (if not all) of these efforts 
have remained at a theoretical level and have not been able to be give rise to successful 
experiments. This is essentially due to the necessity of simulating, in parallel to the system, 
5^ I a quantum filter [1] providing an estimate of the state of the system based on the historic 

of quantum jumps induced by the measurement process. Indeed, it is, in general, difficult 
to perform such simulations in real time. In this paper, we consider a prototype of physical 
systems, the photon-box, where we actually have the time to perform these computations in 
real time (see [G] for a detailed description of this cavity quantum electrodynamics system) . 
Taking into account the measurement-induced quantum projection postulate, the most 
practical measurement protocols in the aim of feedback control are the quantum non-demolition 
(QND) measurements [2, 18, 20]. These are the measurements which preserve the value of 
the measured observable. Indeed, by considering a well-designed QND measurement process 
where the quantum state to be prepared is an eigenstate of the measurement operator, the 
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measurement process, not only, is not an obstacle for the state preparation but can even help 
by adding some controllability. 

In [4, 9, 8] QND measures are exploited to detect and/or produce highly non-classical 
states of light trapped in a super-conducting cavity (see [11, chapter 5] for a description of 
such QED systems and [3] for detailed physical models with QND measures of light using 
atoms). For such experimental setups, we detail and analyze here a feedback scheme that 
stabilizes the cavity field towards any photon- number states (Fock states). Such states are 
strongly non-classical since their photon numbers are perfectly defined. The control corre- 
sponds to a coherent light-pulse injected inside the cavity between atom passages. The overall 
structure of the proposed feedback scheme is inspired by [7] using a quantum adaptation of 
the observer/controller structure widely used for classical systems (see, e.g., [12, chapter 4]). 
As the measurement-induced quantum jumps and the controlled field injection happen in 
a discrete-in-time manner, the observer part of the proposed feedback scheme consists in a 
discrete-time quantum filter. Indeed, the discreteness of the measurement process provides 
us a first prototype of quantum systems where we, actually, have enough time to perform the 
quantum filtering and to compute the measurement-based feedback law to be applied as the 
controller. 

From a mathematical modeling point of view, the quantum filter evolves through a 
discrete-time Markov chain. The estimated state is used in a state-feedback, based on a 
Lyapunov design. Indeed, by considering a natural candidate for the Lyapunov function, we 
propose a feedback law which ensures the decrease of its expectation over the Markov process. 
Therefore, the value of the considered Lyapunov function over the Markov chain defines a 
super-martingale. The convergence analysis of the closed-loop system is, therefore, based on 
some rather classical tools from stochastic stability analysis [l-'S]. 

One of the particular features of the system considered in this paper corresponds to a 
non-negligible delay in the feedback process. In fact, in the experimental setup considered 
through this paper, we have to take into account a delay of d steps between the measurement 
process and the feedback injection. Indeed, there are, constantly, d atoms fiying between the 
photon box (the cavity) to be controlled and the atom-detector (typically d = 5). Therefore, 
in our feedback design, we do not have access to the measurement results for the d last atoms. 
Through this paper, we propose an adaptation of the quantum filter, based on a stochastic 
version of the Smith predictor [17], which takes into account this delay by predicting the 
actual state of the system without having access to the result of d last detections. 

In the next section, we describe briefly the physical system and the associated quantum 
Monte-Carlo model. In Section 3, we consider the dynamics of the open-loop system. We 
will prove, through theorem 1 that the QND measurement process, without any additional 
controlled injection, allows a non-deterministic preparation of the Fock states. Indeed, we will 
see that the associated Markov chain converges, necessarily, towards a Fock state and that 
the probability of converging towards a fixed Fock state is given by its population over the 
initial state. Also, through proposition 1, we will show that the linearized open-loop system 
around a fixed Fock state admits strictly negative Lyapunov exponents (see Appendix B for 
a definition of the Lyapunov exponent). 

In Section 4, we propose a Lyapunov-based feedback design allowing to stabilize globally 
the delayed closed-loop system around a desired Fock state. The theorem 2 proves the almost 
sure convergence of the trajectories of the closed-loop system towards the target Fock state. 
Also, through proposition 2, we will prove that the linearized closed-loop system around the 
target Fock state admits strictly negative Lyapunov exponents. 



Finally in Section 5, we propose a brief discussion on the considered quantum filter and 
by proving a rather general separation principle (theorem 3), we will show a semi-global 
robustness with respect to the knowledge of the initial state of the system. Also, through 
a brief analysis of the linearized system-observer around the target Fock state and applying 
the propositions 1 and 2, we show that its largest Lyapunov exponent is also strictly negative 
(proposition 3). 

A preliminary version of this paper without delay has appeared as a conference paper [15]. 
The delay compensation scheme is borrowed from [('>]. The authors thank M. Brune, I. 
Dotsenko, S. Haroche and J.M. Raimond from ENS for many interesting discussions and 
advices. 

2 A discrete-time Markov process 




Figure 1: The quantum electrodynamic setup including the microwave cavity C with its 
feedback scheme (in green). 



As illustrated by Figure 1, the system consists in C a high-Q microwave cavity, B a box 
producing Rydberg atoms, Ri and i?2 two low-Q Ramsey cavities, D an atom detector and 
S a microwave source. The dynamics model is discret in time and relies on quantum Monte- 
Carlo trajectories (see [11, chapter 4]). Each time-step indexed by the integer k corresponds 
to atom number k coming from B, submitted then to a first Ramsey 7r/2-pulse in Ri, crossing 
the cavity C and being entangled with it, submitted to a second 7r/2-pulse in R2 and finally 
being measured in D. The state of the cavity is associated to a quantized mode. The control 
corresponds to a coherent displacement of amplitude a S C that is applied via the micro- wave 
source S between two atom passages. 

In this paper we consider a finite dimensional approximation of this quantized mode and 
take a truncation to n'"'"' photons. Thus the cavity space is approximated by the Hilbert 



space 



^+1 



. It admits (|0),|1) 



n" 



^)) as ortho-normal basis. Each basis vector \n) G 



C" ^^ corresponds to a pure state, called Fock state, where the cavity has exactly ?i photons, 
n £ {0, . . . ,n™'"'}. In this Fock-states basis the number operator N corresponds to the 
diagonal matrix 

N = diag(0, l,...,n'"="'). 

The annihilation operator truncated to n™="' photons is denoted by a. It corresponds to the 
upper 1-diagonal matrix filled with (-v/T, . . . , \/n™^): 

a |0) =0, a\n) = y/n\n - 1) ioT n = 1, . . . , n'""" 

The truncated creation operator denoted by a^ is the Hermitian conjugate of a. Notice that 
we still have N = a^a, but truncation does not preserve the usual commutation [a, a^^] = 1 
that is only valid when n™'"' = +oo. 

Just after the measurement of the atom number k — 1, the state of the cavity is described 
by the density matrix pi^ belonging to the following set of well-defined density matrices: 



X 



[pGd"-+i)^ I p = pt, Tr(p) = l, p>0}. (1) 



The random evolution of this state pk can be modeled through a discrete-time Markov pro- 
cess that will be described bellow (see [6] and the references therein explaining the physical 
modeling assumptions). 

Let us denote hy ak G C the control at step k. Then pk+i, the cavity state after measure- 
ment of atom k is given by 



Pk+i=Ms,{p^^), Pfc+i =B„,_,(pfc) (2) 

where, 

• Sfe G {g, e}, MJp) = -JfiEMl Me(p) = f-^^%, with operators M„ = cos ((^o + ^N) 



and Me = sin {ipo + t?N) {(po,'& constant parameters). For any n e {0, . . . , n™'"'} we set 

• Oa(p) = DapDa where the unitary displacement operator Da is given by Da = 
goa -a a j^ open-loop, = 0, Dq = I (identity operator) and Bo(/o) = p. Notice 
that dI = D_a- 

• Sfc is a random variable taking the value g when the atom k is detected in g (resp. e 
when the atom k is detected in e) with probability 

Pg^k = Tr (Mgp;- + 1 Aft) (resp. Pe,fc = Tr ^Mep^^ i Mj) ) . (3) 

• The control elaborated at step k, a^, is subject to a delay of d steps, d being the number 
of flying atoms between the cavity C and the detector D. 

We will assume through out the paper that the parameters ipo, t? are chosen in order to have 
Mg, Me invertible and such that the spectrum of MgMg = Mg and MjMe = Mg are not 
degenerate. This implies that the nonlinear operators M^ and Mg are well defined for all 
p £ X and that Wlg{p) and Me(p) belongs also to the state space X defined by (1). Notice 
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Figure 2: (3|/9fc|3) (fidelity with respect to the 3-photon state) versus the number of passing 
atoms k € {0, . . . , 400} for 100 reahzations of the open-loop Markov process (6) (blue fine 
curves) starting from the same coherent state po = D/^{\0) (0|). The ensemble average over 
these realizations corresponds to the thick red curve. 
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that Mg and Mg commute, are diagonal in the Fock basis and satisfy MgMg + MeM^, = I. 
The Kraus map associated to this Markov process is given by: 



]K,(p) = MgD^pDiMl + MeDapDiMl 
It corresponds to the expectation value of Pk+i knowing p^ and ak~d'- 

IE(pfc+l I Pk,0!k-d) = ^a^^^aiPk)- 



(4) 



(5) 



3 Open loop dynamics 

3.1 Simulations 

We consider in this section the following dynamics 



Pk+i 



kiPk), 



(6) 



obtained from (2) when ak-d = 0. Figure 2 corresponds to 100 realizations of this Markov 
process with n™''" = 10 photons, ^ = ^tj and ipo = j — 3^. For each realization, pQ is initialized 
to the the same coherent state D /gdO) (0|) with Tr(Npo) ~ 3 as mean photon number. We 
observe that either (3|pfc|3) tends to 1 or 0. Since the ensemble average curve is almost 
constant, the proportion of trajectories for which (3|pfc|3) tends to 1 is given approximatively 
by (3|po|3). 



3.2 Global convergence analysis 

The following theorem underlies the observations made for simulations of Figure 2 

Theorem 1. Consider the Markov process pk obeying (6) with an initial condition po £ X 
defined by (1). Then 

• for any n G {0, • • • , n™"^}, Tr{pk \n) (n|) = (n| p^ \n) is a martingale 

• Pk converges with probability 1 to one of the n™"^ + 1 Fock state \n) {n\ with n G 
{O,--- ,n'"""}. 

• the probability to converge towards the Fock state \n) {n\ is given by Tr{pQ \n) {n\) = 
{n\po\n). 

Proof. Let us prove that Tr (p^ \n) {n\) is a martingale. Set ^ = \n) {n\. We have 
E (Tr iCPk+i) I Pk) = Pg,kTr (^^^^f^) + Pe.fcTr (^^M^bM' 



TV (eMgPfcMt) + Tr (^MePfeMj) = Tr (^pk{Ml^Mg + mI^M, 



Since ^ commutes with Mg and Me and MlMg + ulUe = I we have E (Tr {£,Pk+i) \ Pk) = 
Tr(C;Ofe). 

Considering the following function: 

Vn{p) = f{{n\p\n)), 
where f{x) = ^^^ ■ Notice that / is 1-convexe, /' > 2 on [0, 1] and satisfies 

V(x,y,0)G[O,l], 9f{x) + {l-e)f{y)='-^{x-y)^ + f{ex+{l-e)y). (7) 

The function / is increasing and convex and {n\pk\n) is a martingale. Thus Vn{pk) is sub- 
martingale. Since 

{n\Mg{p)\n) = ;°^''^" ,. {n\p\n) , {n\M,{p)\n) = f "''^" .. {n\p\n) 
we have 



E (V„(pt+i) I pO = Tr [M,pi.Ml) f I ^rj^,n ("lml"> 



+ T,.(M.p.AfI)/Ujj|j^(„|«|„) 



Then (7), together with 



« = ^' (m»«M.) . . = ^^g^ (n|«|„) , y = ^^^^ („|«|n) 






yields to 

E{Vn{pk+l) I Pk) - Vnipk) = 

Tr(MsPfcMt)Tr(MePfcMt)((n|pfe|n))2 



Thus we recover that Vn{pk) is a sub-martingale, E,{Vn{pk+i) I Pk) ^ ^(Pfc)- We have also 
shown that E(y„(/>fc+i) | pk) = Vn{pk) implies that either {n\pk\n) = or Tr (MgpkMg 

cos'^ifn (assumption Mg and Me invertible is used here). 

We apply now the invariance theorem established by Kushner [13] (recalled in the Ap- 
pendix A) for the Markov process pk and the sub- martingale Vn{pk)- This theorem implies 
that the Markov process pk converges in probability to the largest invariant subset of 

ip€X \Tr (UgpMl) = cosVn or {n\p\n) = o| . 

But the set {p ^ X \ {n\p\n) = 0} is invariant. It remains thus to characterized the largest 
invariant subset denoted by Xn and included in < p G A' | Tr ( MgpMg j = cos^ifn \ ■ 

Take p S Xn. Invariance means that Mg(p) and Me(yo) belong to Xn (the fact that Mg and 
Me are invertible ensures that probabilities to jump with s = g oi s = e are strictly positive 
for any pe X). Consequently Tr (MgMg{p)Mf\ = Tr (Ugpuf) = cos^c^^. This means that 
Tr {M^p) = Tr^ (M^p) . By Cauchy-Schwartz inequality, 

Tr (M» = Tr (M» Tr {p) > Tr^ (M^p) 

with equality if, and only if, M^p and p are co-linear. M^ being non-degenerate, p is nec- 
essarily a projector over an eigenstate of M^, i.e., p = \m) {m\ for some m G {0, . . . ,n™'"'}. 

Since Tr (MgpMg j = cos^cpn > 0, m = n and thus Xn is reduced to {\n) {n\}. Therefore the 
only possibilities for the cj-limit set are Tr (p|n) (n|) = or 1 and 

Wnipk) = Tr (pk \n) (n|) (1 - Tr {pk \n) {n\) — ^ in probability. 

The convergence in probability together with the fact that Wn{pk) is a positive bounded 
{Wn G [0, 1]) random process implies the convergence in expectation. Indeed 

hmsupE{Wn{pk)) < elimsupF {Wn{pk) < e) + lim sup F {Wn{pk) > e) 

< e + limsupP(VF„(/Ofc) > e) < e, 

fc— >oo 

where for the last inequality, we have applied the convergence in probability of Wn{pk) towards 
0. As the above inequality is valid for any e > 0, we have 

\imEiWniPk)) = 0. 

Furthermore, by the first part of the Theorem, we know that Tr (pk \n) (n|) is a bounded 
martingale and therefore by the Doob's first martingale convergence theorem (see the Theo- 
rem 4 of the Appendix A), Tr (pk \n) (n|) converges almost surely towards a random variable 



l"^ G [0,1]- This implies that Wn{pk) converges ahnost surely towards the random variable 
1^(1 — l^) £ [0,1]. We apply now the dominated convergence theorem 



E(/-(l - O) = E lim Wnipk) = lim E{Wn{pk)) = 0. 
yfc— >oo y k—^oo 

This implies that /Jf (1 — /Jf ) vanishes almost surely and therefore 

Wnipk) = Tr {pk \n) {n\) (1 - Tr {pk \n) (n|)) -^ almost surely. 

As we can repeat this same analysis for any choice of n G {0, 1, . . . , n™""}, p^ converges almost 
surely to the set of of Fock states 

{\n){n\ I n = 0,l,...,n-^''}, 

which ends the proof of the second part. 

We have shown that the probability measure associated to the random variable pk con- 
verges to the probability measure 

„niax 

^p„5(|n)(n|), 

n=0 

where S{\n) (n|) denotes the Dirac distribution at \n) {n\ and pn is the probability of conver- 
gence towards \n) {n\. In particular, we have 

E(Tr(|n) {n\ pk)) ^ Pn- 

But Tr (|n) {n\ pk) is a martingale and E (Tr (|n) {n\ p^)) = E (Tr (|n) {n\ po))- Thus 

Pn = {n\ po \n) , 

which ends the proof of the third and last part. 

D 

3.3 Local convergence rate 

According to theorem 1, the ri-limit set of the Markov process (6) is the discrete set of Fock 
states {\n) (n|}„g|o^...^„max}.. We investigate here the local convergence rate around one of 
these Fock states denoted hy p = \n) {n\ for some n € {0, . . . , n™'"'}. 

Since Wlg{p) = Me(/j) = p, we can develop the dynamics (6) around the fixed point p. We 
write p = p + 5p with 6p small, Hermitian and with zero trace. Keeping only the first order 
terms in (6), we have 

Tt(Ms.pMIA TvfMs.pAll 



Spk+1 



Thus the linearized Markov process around the fixed point p reads 



5pk+i = AsJpkAl^ - Tr [AsJpkA\jj p (8) 

where the random matrices Ag^, are given by : 



Ag = J' with probability Pg = cos^ipf, 



Ae = g;^^_ with probabihty Pg = sin ip. 



The fohowing proposition shows that the convergence of the hnearized dynamics is exponential 
(a crucial robustness indication). 

Proposition 1. Consider the linear Markov chain (8) of state 5p belonging to the set of 
Hermitian matrices with zero trace. Then the largest Lyapunov exponent A is given by (ipn = 
ipo + ni}) 



A = max ( cos Pf) log I ^ ) + sin ipfj log , , 

n j^ fb 

and is strictly negative: A < 0. 

Proof. Set (5/9"i'"2 = {ni\6p\n2) for any ni, n2 G {0, . . . , n™''''}. Since Tr {6pk) = 0, we exclude 
here the case (ni,n2) = {n,n) because dp^'^ = —'^n^n^p^'^- Since Ae and ^4^ are diagonal 
matrices, we have 

spT+r = "".""^^/^r'"' (9) 

where Sk = g (resp. Sk = e) with probability cos'^ ^pn (resp. sin^c^fj) and where a^^'"^ = 

cos 95„-^ cos (/3„2 1 ni,«2 sin (/3„j sin (p„2 

—2—- ana Oe — — -r-j 



COS^ I/3n sin ipn 

Denote by A"!'"^ the Lyapunov exponent of (9) for (ni, 712) 7^ (n, n). By the law of large 
numbers, we know that — ^^^ — fc+i converges almost surely towards 

cosVn log(|a^^'"2|)+sinVn log(|a^i'"2|). 
Thus, we have 

A-- = cos^ pn (log (^^) + log (^^)) 

+ --V.(log(^|^)+log 
The function 



vr 
°-2 



\ cos'^ (pfi / ■ \ sin^ (pfi 

COS p \ I sm V? ^ 

' ' COS (/?n I y VI S™ V'n 



increases strictly from to 1 when p goes from to arcsin(| sinc^fij) and decreases strictly 
from 1 to when p goes from arcsin(| sin(/9fi|) to ^. Since (^1,722) 7^ {n,n), A"'!'"^ < 0. 
Denote by A" = A"-" forn G {0, . . . , n"^""}: 



A- = cosV.log(^)+sinV.log 



sin Ipn I 



Since (ni,n2) 7^ {n,n), we have A"i'"2 < max„^jj A" and A = max„^^, A*^ is strictly negative. 

D 
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Figure 3: Tr (pfcp) = (3|/Ofc|3) versus k G {0, ...,400} for 100 realizations of the closed- 
loop Markov process (2) with feedback (10) (blue fine curves) starting from the same state 
po = D /gdO) (0|) (no delay, d = 0). The ensemble average over these realizations corresponds 
to the thick red curve. 
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Figure 4: Tr (p/^p) = (3|pfe|3) versus k G {0, ...,400} for 100 realizations of the closed- 
loop Markov process (12) with feedback (11) (blue fine curves) starting from the same state 
Xo = (O /gdO) (0|),0, ... ,0) and with 5-step delay (d = 5). The ensemble average over these 
realizations corresponds to the thick red curve. 



10 



4 Feedback stabilization with delays 

4.1 Feedback scheme and closed-loop simulations 

Through out this section we assume that we have access at each step k to the cavity state 
Pk- The goal is to design a causal feedback law that stabilizes globally the Markov chain (2) 
towards a goal Fock state p = \n) {n\ with n photon(s), n G {0, . . . ,n™''''}. To be consistent 
with truncation to n"""" photons, n has to be far from n™'"' (typically n = 3 with n™'"' = 10 
in the simulations below). 

The feedback is based on the fact that, in open-loop when a/. = 0, Tr (ppk) = {n\pk\n) is a 
martingale. When d = 0, [15] proves global almost sure convergence of the following feedback 
law 

[ eTr (p [pk,a]) if Tr (ppk) > t] 

ak = \ argmax (Tr (p D„(pfc))) if TV {ppk) < v (1°) 

L |a|<a 

for any a > when €,rj > are small enough. This feedback law ensures that Tr (ppk) is a 
sub-martingale. 

When d > 0, we cannot set Ok-d = eTr (p [pfc,a]) since Uk will depend on pk+d and the 
feedback law is not causal. In [G], this feedback law is made causal by replacing pk+d by its 
expectation value (average prediction) p^"""* knowing pk and the past controls Uk-i, ■ ■ ■ , Uk/- 

■°^ak-APk) 



prcd 

Pk 



'"Ofc-l 



where the Kraus map Kq, is defined by (4). 

We will thus consider here the following causal feedback based on an average compensation 
of the delay d 



eTr(p[pr',a: 



0!k 



argmax ( Tr ( p 

|a|<a 



^K:r))Tr 



^(p^r; 



if TV {ppl-'^) 
if Tr {ppr') 



> T] 

< rj 



(11) 



with 



pred 

Pg^k 

prcd 

Pg,k 



'"Ofc-l 



'-c.,_,^AMaD^,_,PkDl,_,Ml,, 



The closed-loop system, i.e. Markov chain (2) with the causal feedback (11) is still a 
Markov chain but with (pfc,afc_i,--- ,afc-d) as state at step k. More precisely, denote by 
X = (p, /3i, • • • , Pd) this state where j3i stands for the control a delayed I steps. Then the state 
form of the closed-loop dynamics reads 

Pfc+i =M,,(B^,^,(pfc)) 

Pl,k+1 = Oik 

h,k+i = Pi,k (12) 

, Pd,k+l = f3d-l,k- 

where the control law defined by (11) corresponds to a static state feedback since 



pr' = p^-'{xk) = EiPk+d\xk) 



prcd 

Pg^k 

prcd 

I Pe,k 



pr'ixk) 



pr'ixk) = %,,, o 



oKf- 



K,3,^^o...oK,3aJpk) 

-.^MgDp^^PkDl^Ml) 
_,jM,Dp^^^PkDlMh 



(13) 



11 



Notice that pr = P^:r + P^'-. 

Simulations displayed on Figures 3 and 4 correspond to 100 realizations of the above 

closed-loop systems with d = and d = 5. The goal state p = |3) (3| contains n = 3 photons 

and n°""', ipo and t} are those used for the open-loop simulations of Figure 2. Each realization 

starts with the same coherent state po = B /gdO) (0|) and /3i q = . . . = /3d,o = 0. The feedback 

parameters appearing in (11) are as follows: 

'- 1 - 1 V = Tn, a=l. 



2n+l ~ 7' '/ — 10' 

This simulations illustrate the influence of the delay d on the average convergence speed: the 
longer the delay is the slower convergence speed becomes. 

Remark 1. The choice of the feedback law whenever Tr(^pp^j^'^^ < rj might seem complicated 
for real-time simulation issues. However, this choice is only technical. Actually, any non- 
zero constant feedback law will seems to achieve the task here (see for instance the simulations 
of [6]). However, the convergence proof for such simplified control scheme is more complicated 
and not considered in this paper. 

4.2 Global convergence in closed-loop 

Theorem 2. Take the Markov chain (12) with the feedback (11) where p^^""^ , p^J"^ and p'^J'j^ 
are given by (13) with a > 0. Then, for small enough e > and r] > 0, the state Xk converges 
almost surely towards x = (Pi 0, . . . , 0) whatever the initial condition xo £ '^ >< C'^ is (the 
compact set X is defined by {!)). 

Proof. It is based on the Lyapunov-type function 

y(x) = /(Tr(pp--^)) with p--''=Kp,o...o^p^{p) (14) 

where f{x) = ^~[^ has already been used during the proof of theorem 1. The proof relies in 
4 lemmas: 



• 



• 



in lemma 1, we prove an inequality showing that, for small enough e, V{x) and Tr (p/0'^'°''(x)) 
are sub-martingales within {x | Tr (/3/jP"''"*) > rf\. 

in lemma 2, we show that for small enough r/, the trajectories starting within the set 
{x I TV (ppP"''"*) < ?]} always reach in one step the set {x | Tr (ppP'"'*) > 277}; 

in lemma 3, we show that the trajectories starting within the set {x | Tr {pp^'""^) > 2r/}, 
will never hit the set {x | Tr (p/o'"""^) < r]} with a uniformly non-zero probability p > 0; 

in lemma 4, we combine the first step and the invariance principle due to Kushner, 
to prove that almost all trajectories remaining inside {x | Tr {pp^"'"^) > r]} converge 
towards x = (p, 0, . . . , 0). 

The combination of lemmas 2, 3 and 4 shows then directly that Xk converges almost surely 
towards x- We detail now these 4 lemmas. D 

Lemma 1. For e > small enough and for Xk satisfying Tr(pp'"''"''(xk)) ^ V> 
E(Tr(pp-^(Xfe+i)) I Xk) > Tr{pp--\xk))+e\Tr{-p [p'^'\^])\^ 
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and also 

E(y(xfc+i) I Xk) > V{xk) + ^\Tr{p [pr',a])|' 

+ ^^ ( Tr {p D«, o K^^^^ o . . . o K^^_^^ o M, o B^,,, (pk)) 

- Tr{p D„, o IC;3,,, o . . . o ^p^_^^^ o M, o D^, ,(Pfc)) ) (15) 
Proof. Since MJM^ + ulUe = I and [p, Mg] = [p, A/e] = 0, we have 
Tr (p %^ ,.+^ o ]K^^_^^^ o . . . o ]K^^_^^^(/5fc+i)) = 

Also, we have: 

E (/ (Tr (p %,^,+i o IK;52_,^^ o • • • o %,,,,+! (Pfc+i))) I Xfc) = 

P,,fc/ (Tr (p D,, o ^p_^^^ o . . . o ]K;3,_^^^. o M, o B;3,,,(Pfc))) + 

Pe,fc/ (Tr (p D,, o K^^^^ o . . . o 1C^^_^^^ o Me o I}p,^,{pk))) . 

By (7) we find 

E (Vixk+i) I Xfe) = / (Tr (p D„, o Kp,, o • • • o ]K^,_^ ,_ o K^,, Jp^o))) 

+ ^^^ ( Tr (p D„, o Kp,^ o . . . o K^,_^^ (Mg o ©^...(p,) - M^ o D^, ,(p,.))) )' 

Since pP"'=''(xfc) = Pk"" = IK/j^^^ o • • • o %^_^_^, o ]K/3^_^(pfc) we have 

Tr (p ©„, o K^^,, o . . . o K^,_^ , o K^, , (p,)) = Tr (p ©„, (pr')) 
For a small the Baker-Cainpbell-Hausdorff formula yields 

B„(p) = e<^«^-"*^ p e-("at-a*a) ^ ^ ^ j^^f _ a* a, p] + 0{\a\^) 
Consequently 

Tr (p B«,(pr<^)) = lY (p p^"^) + TV (p [a^at - a*fca,pr'^]) + 0(|afcp). 

Since a/c = eTr (p[p^/°'', a]) , we get 

Tr (p D„, (pr^^)) = TV (p p^"^) + 26 |T¥ (pbr', a]) |' + Oie'). 
Thus for e > small enough and uniformly in p^"""^ G X 

Tr (p B„, (p^ )) > Tr (p p-^) + e |Tr {p[pl-\ a]) f . 
Using the fact that / is increasing and /(x + y) > /(x) + y/2 for any x, y > 0, we get 

/ (Tr (p- B„,(pr ))) > /((Tr (p" pr')) + f |Tr (pipr , a]) ^ . 

D 
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Lemma 2. Whenr] > is small enough, any state Xk satisfying the inequality Tr{pp'"''^{xk)) < 
i] yields a new state Xk+i such that Tr{pp^'''"^{xk+i)) > 27?. 

Proof. Since Mg and Me are invertible, there exists C, E]0, 1[ such that, for any x, Tr {p^g'"^{x)) ^ 
C, and Tr (/9P''°'*(x)) > C {p^g""^ ^^d p^^''^ are defined in (13)). Denote by Xq the compact set of 
Hermitian semi-definite positive matrices with trace in [C, 1]: for any x, p^q'"^{x) ^-nd p^e'"^{x) 
are in X(^. Let us prove first that, for any Pg,pe G Xc_ 

max (T¥ [p H^ipg)) Tr (p ©^(pe))) > 0. (16) 

|o|<Q 

If for some Pg,Pe £ '^f, the above maximum is zero, then for all a G C (analyticity of Da 
versus 3f?(a) and 9(a)): 

TT{pOa{pg))Tl{pBa{pe)) = 0. 

This implies that either Tr (p Oa.{pg)) = or Tr (p ©^(pe)) = (if the product of two analytic 
functions is zero, one of them is zero). Take p G Af^ such that Tr (p ©^(p)) = 0. We can 
decompose p as a sum of projectors, 

m 

where \y are strictly positive eigenvalues, ^^ \y S [C, 1], and il)y are the associated normalized 
eigenstates of p, 1 < m < n™'"'. Since Tr (p Dq(p)) = for all a G C , we have for all 
i^, (^jy| Da|ra) = 0. Fixing one v G {l,'"" )"*-} and taking ip = ip^ noting that D^ = 
exp(K(a)(aT — a) + z3'(a)(aT + a) and deriving j times versus K(a) and 3'(a) around a = 
we get, 

V I (a"^ - a)^'|n\ = (ip \ {a^ + a)^'|n\ =0 Vj > 0. 



With j = 0, we get, {^l; \n) = 0. With j = 1 we get {ip |n — 1) = (-0 |n + 1) =0 since 
a^ |n) = \/n + 1 |n + 1) and a|n) = y/E\n — 1). With j = 2 and using the nuh Hermitian 
products obtained for j = and 1, we deduce that {ip |n — 2) = (^ \n + 2) = 0, since aa' \n) 
and a^^a|n) are colinear to \n). Similarly for any j and using the null Hermitian products 
obtained for j' < j, we deduce that {tp |max(0, n — j)) = {ip | min(n'"'''',n + j)) = 0. Thus, 
for any n, (tpln) = 0, |V') = and we get a contradiction. Thus (16) holds true for any 
Pg,Pe G Af^. 
The map F 

{pg, pe) H> F{pg,pe) = max (Tr (p B^ipg)) Tr (p Baipe))) 

\a\<a 

is continuous. We have proved that for all Pg,Pe in the compact set A'^, F{pg,pe) > 0. Thus 
exists 5 > such that F{pg, pe) > S for any pg, pe G X^. Take a an argument of the maximum, 

Tr (p BaiPg)) Tr (p Bfi(pe)) = max (Tr (p ©^(p^)) Tr (p B„(pe))) > S 

\a\<a 



Since (Cauchy-Schwartz inequality for the Frobenius product) Tr (p Da(pg)) < 1 and Tr (p ©^(pe)) < 
1, we have Tr (p ©^(pg)) > 5 and Tr (p ©^(pe)) > 5. 

2 ^ 
an argument of 

max(Tr(pD.(p-r))Tr(p-D„(p-r))) 



Take now rj < ^ and Xk such that Tr (ppP''°''(xfc)) < rj. According to (11), a^ is chosen as 



|a|<a 
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where p^;^',^^;^' G Af<^. Thus Tr l^p B^^{plf)j > 6 and Tr i^p B^Mf)) > ^- But either 
Pk+i = 7^^c.fc(p^l'*) or pI!^\ = ^Kai^Xp^jf) where < Pg,k,Pe,k < 1- Since we have the 
identity Ti (pKa{p)) = Ti {pDa{p)) because p commutes with Mg and M^, we conclude that 
Tr(ppP-<^(Xfc+i))>5>277. D 

Lemma 3. Initializing the Markov process Xk within the set {x \ Tr{pp'"''"'{x)) ^ ^r/}, Xk 
will never hit the set {x \ Tr{pp'"''"''{x)) < f]} with a probability 

p > —^ > 0. 
1 — r] 

Proof. We know from lemma 1 that the process 1 — Tr {pp^'^'"^ix)) is a super martingale in the 
set {x I Tr (/3/>'"'°'*(x)) > r/}. Therefore, one only needs to use the Doobs inequality recalled 
in appendix: 

f( sup (l-T.(pp.~-(X>)))>l-.l> ^-^'f^""'^°» >i^. 

and thus p > 1 — t^-^ = -r^. D 

^ l—T] 1 — 7) 

Lemma 4. Sample paths Xk remaining in the set {Tr{pp'"''"^{x)) ^ v} converges almost surely 
to X as A; — )■ oo. 

Proof. We apply first the Kushner's invariance theorem to the Markov process Xk with the 
sub-martingale function V{xk)- It ensures convergence in probability towards X the largest 
invariant set attached to this sub-martingale (see appendix). Let us prove that X is reduced 
to {x}. 

By inequality (15), if {p,f3i, . . . ,j3d) = X belongs to X then Tr (p [pP'''"*(x),a]), i.e., a = 
and also 

Tr (p B„ o K^^ o . . . o K^^_^ o Mg o Bp^{p)) = 

Tr (p B„ o K^^ o . . . o !C^^_^ o Me o Mp^ip)) . 

Invariance associated a = implies that /3i = . . . = /^^ = 0. Thus the above equality reads 

Tr(pMg(p))=Tr(pMe(p)) 

where we have used the fact that, for any ^ G A', Tr (p ]Ko(£i)) = Tr (p Bo(^)) = Tr {pg). Then 
p satisfies 

Tr [pMgpMpj Tr {MepU}^ = Tr [pMepM}}j TV {Ugpuf^ 

that reads, since MgpMg = cos'^ipn p, MlpMf. = sin^c^fi p and Tr {pp) > 0, 

cosVnTV (MepM}^ = sinVnTV {MgpM}^ . 

Since Tr ( M^pM^ 1 -|-Tr ( MgpMg 1 = 1, we recover Tr ( MgpMg 1 = cos^ipn the same condition 
as the one appearing at the end of the proof of theorem 1. Similar invariance arguments 
combined with Tr (pp) > imply then p = p. Thus X is reduced to {x}- 
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Consider now the event P>^ = {V/c > 0, Tr {pp^'''"^{xk)) > i]}}- Convergence of Xk in 
probability towards x nieans that 

\/5>0, lim ¥ iWxk - X\\ > 5 \ P>r,) = 0. 

k—>oo 

where || • || is any norm on the x-space. The continuity of x *~^ Tr (/)pP''°'*(x)) imphes that, 
V(5>0, 

Hm P(Tr (pp^-'^(xfc)) < 1 - 5 | P>^) = 0. 

As < Tr [pp^'^'^x)) < 1, we have 

1 > E (Tr {pp^-'{xk)) I P>r,) > il-6)F{l-5< Tr {pp^-'{xk)) I P>rj) ■ 
Thus 

1 > E (Tr ipp''-'ixk)) \P>v) > 1-5-F (Tr (pp'-'ixk)) < 1 - 5 | P>,) . 
and consequently, \/6 > 0, limsup E (Tr {pp^'''"^{xk)) \ P>rj) > 1 — (5, i.e., 

fc— ^-oo 

limE(Tr(pp-^'^(Xfc)) \P>r,) = l- 

fe— >oo 

The process Tr {pp'^'""^{xk)) is a bounded sub-martingale and therefore, by Theorem 4 of 
the Appendix A, we know that it converges for almost all trajectories remaining in the set 
{Tr (pp^'^'^^ix)) ^ I]}- Calling the limit random variable fidoo, we have by dominated conver- 
gence theorem 



E (fidoo) = E hm Tiipp^-^ixk)) \P>v]= lim E{Tv {pp-^^ixk)) \ P>n) = 1- 

yfc— >oo J k~>-co 

This trivially proves that fidoo = 1 almost surely and finishes the proof of the Lemma. D 

4.3 Convergence rate around the target state 

Around the target state x = (P) 0, . . . , 0) the closed-loop dynamics reads 

p,+i=M,,,(%.,.(Pfe)) 
/3i,fc+i = eTr ([a, p] K^^^^ o . . . o Kfj^,^{pk)) 



f3d,k+l = l3d-l,k- 

Set X = X + ^X with 5x = {5p-, (J/3i, . . . , 5j3d) small. Computations based on 
^sp{p) = P+ ('^/3[a^p] - 5/3* [a, p]) +0(|<5/3|2), 
^sp{p) = IKo(p) + cos ^ (5/3 [at, p] - 5/3*[a,/5]) + 0(|<5/3|2), 
]Ko(p) = p, Kq{[&\p\) = cost? [a\p\, Ko([a,p]) = cost? [a,p], 
Tr([a,p][at,p]) =-(2n + l) and Tr ([a, p]^) = 0, 
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yield the following linearized closed-loop system 

5pk+i = As, (5pk + 5l3dA^\p] - <5/3*_ Ja, p]^ A\^ - Tr {A^JpuAl^) p 
5PiM+i = -e(2fi + 1) (Eti cos^'^ SP^^ + ecos^i? Tr {5pk[a,p]) 



where Sk G {g,e}, the random matrices ^s^. are given by Ag = ^^^^_ with probability 
Pg = cos'^ifn and A^ = -■ — ^— with probability P^ = siia^ipn- 

Set Sp^^'^^ = {ni\6pk\n2) for any ni,n2 E {0, . . . , n™''''}. Since Tr((5pfc) = 0, we exclude 
here the case (ni, n2) = {n, n) because 5p^'^ = — Yln^n ^Pk^ ■ When (ni, 712) does not belong 
to {(n — 1, n), (n+1, n), (n, n — 1), (n, n+1)}, we recover the open-loop linearized dynamics (9): 

where s^ = g (resp. s^ = e) with probability cos^y^fi (resp. sin^c^f^) and where a^^'"^ = 

COSipn-. COSipny j 721,712 sin(/3„-| sill l^n, A J- J- J J- J-- J? J-U f f -j-- 1 

T and Oe = 7-S ^. A du'ect adaptation or the prooi oi proposition 1 

cos-' if fi, '^ Sm-' ipil '■ !:■ f f 

shows that the largest Lyapounov exponent Aq of this dynamics is strictly negative and given 
by 



Ao = max f cosVn log (\^^] + sinVn log f H^ 

n j^ n — l,n,n + 1 



For (ni, 712) E {("- — ^,n), (n + l,n), {n,n — 1), (n,n + 1)}, we just have to consider x = 
Sp"-'"--^ and y = 5p"'~^^'^ since 5p is Hermitian. Set Zj^k = SPj,k- We deduce from (17) that 
the process Xk = {xk,yk, ^^i.fc, • • • , Zd,k) is governed by 



Xk+i = askJXk - VnzdA 
yk+i = bsk ivk + \/n + lzd,k) 
zi,k+i = -e(2?l, + 1) (^Ei=i cos^ ^Zj A + e cos'^t? ( Vn^a^fc - V" + ll/fe) 

2d,fc+l = 2d_l,fc 
where Sk = g (resp. Sk = e) with probability cos^c/^n (resp. sin^(^fi) and 

_ COSyn^l _ Sinyn-l , _ COS (fifj + l , _ sinyn + i 

Take /u > to be defined later, set o" = | cos ^| G]0, 1[ and consider 

V{X) = \x\ + |y| + ^ (|zi| + a\z2\ + ■■■ + a'^~'^\zd\ 

A direct computation exploiting (18) yields 

E {V{Xk+i) I Xk) = a\xk - V^Zd,k\ + cr\yk + Vn+ lzd,k\ 

+ crp (1^1,^1 + <7\z2,k\ H 1- (y'^^'^\zd-i,k\) 



(18) 



ep 



-(2n + 1) ^ cos-'i?Zj,fe + cos'^T? (Vnxk - \fn + \yk 
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Thus 

E(y(Xfe+i) I Xk) < i<J + efia^'Vn + T)i\xk\ + \yk\) 

Take fi = ^+,^ , then 

E {V{Xk+i) I Xfc) < ct(1 + 2e(n + 1)) V{Xk). 

Because a < 1, for e > smah enough (e < 2(n+i) ) ^^^ norm y(Xfc) is a super-martingale 
converging exponentiahy almost surely towards zero. Thus the largest Lyapunov exponent of 
the linear Markov chain (18) is strictly negative. To conclude, we have proved the following 
proposition: 

Proposition 2. Consider the linear Markov chain (17). For small enough e > 0, its largest 
Lyapunov exponent is strictly negative. 

5 Quantum filter and separation principle 

5.1 Quantum filter and closed-loop simulations 

The feedback law (11) requires the knowledge of {pk,l3i,k, ■ ■ ■ if^d^k)- When the measurement 
process is fully efficient and the jump model (2) admits no error, the Markov system (12) 
represents a natural choice for the quantum filter to estimate the value of p. Indeed, we define 
the estimator xT ~ (/^fc*"^!.^' ' ' ' ^Pd,k) satisfying the dynamics 

/5i,fc+i = Ofc 

/52,fc+i = /3i,fc (19) 

, /3d,fc+l = Pd-l,k- 

Note that, similarly to any observer-controller structure, the jump result, Sk = g or e, is the 
output of the physical system (2) but the feedback control a^ is a function of the estimator 
/o''^*. Indeed, ak is defined as in (11): 

( eTr {p [pl'^^-^'^a]) if Tr (p^r'''"') > V 

«fc = j argmax (Tr (p D„ (plf'^) Tr (p B„ (p^^f •°=')) ) if Tr {ppr^'^^') < v (^0) 

where the predictor's state pP"'"'*'"^* ig defined as follows: 

pr-' = ]K,,_,o...o]K,^_^(p-) 

PlT'' = ^o.,_, o . . . o K^^_^^^{M,D^^_^prDl_,Mh 

We will see through this section that, even if do not have any a priori knowledge of the initial 
state of the physical system, the choice of the feedback law through the above quantum filter 
can ensure the convergence of the system towards the desired Fock state. Indeed, we prove a 
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semi-global robustness of the feedback scheme with respect to the choice of the initial state 
of the quantum filter. 

Before going through the details of this robustness analysis, let us illustrate it through 
some numerical simulations. In the simulations of Figure 5, we assume no a priori knowledge 
on the initial state of the system. Therefore, we initialize the filter equation at the maximally 
mixed state Pq^ = ^^mai . ^ II(nm=^x+i) x (nm^^^+i) • Computing the feedback control through the 
above quantum filter and injecting it to the physical system modeled by (2), the fidelity (with 
respect to the target Fock state) of the closed-loop trajectories of the physical system are 
illustrated in the first plot of Figure 5. The second plot of this figure, illustrate the Frobenius 
distance between the estimator p"^^ and the physical state p. As one can easily see, one still 
have the convergence of the quantum filter and the physical system to the desired Fock state 
(here |3) (3|). 

Through these simulations, we have considered the same measurement and control param- 
eters as those of Section 4. The system is initialized at the coherent state po = D /gdO) (0|) 

while the quantum filter is initialized at Pq^ = „max i x I(n"'="^+i)x (n™'"''+i) • 

Through the next subsection, we establish a sort of separation principle implying this 
semi-global robustness of the closed-loop system with respect to the initial state of the filter 
equation. Also through the short Subsection 5.3 we provide a heuristic analysis of the local 
convergence rate of the filter equation around the target Fock state. 

5.2 A quantum separation principle 

We consider the joint system-observer dynamics defined for the state S^ = (pfc, p^*, /3i,fc, . . . , Pd,k) 



(21) 



/3d,fc+l = Pd-l,k- 

We have the following result, a quantum version of the separation principle ensuring asymp- 
totic stability of observer/controller from stability of the observer and of the controller sepa- 
ratly. 

Theorem 3. Consider any closed-loop system of the form (21), where the feedback law a^ is 
a function of the quantum filter: at = g{p'jf^,(3i^k, ■ ■ ■ j/^d.fc)- Assume moreover that, whenever 
pT ~ Po (^0 ^^^^ ^^6 quantum filter coincides with the closed-loop dynamics (12) j, the closed- 
loop system converges almost surely towards a fixed pure state p. Then, for any choice of 
the initial state p^^, such that kerp^* C kerpQ, the trajectories of the system converge almost 
surely towards the same pure state: pk — )• p. 

Remark 2. One only needs to choose p^^ = ^ma^ i ]^ I(ra'"''^+i)x(n""'^+i); -^o that the assumption 
kerpQ^ C kerpo is satisfied for any pQ. 

Proof. The basic idea is based on the fact that E (Tr (p^p) | pq,Pq^) (where we take the 
expectation over all jump realizations) depends linearly on po even though we are applying a 
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Figure 5: (First plot) Tr (pfep) = (3|pfe|3) versus k £ {0,. . . ,400} for 100 realizations of the 
closed-loop Markov process (2) with feedback (20) based on the quantum filter (19) starting 
from the same state Xo* = ( „max_|_i II(n'"=^''+i)x (n^'^'^+i) ? 0; • • • ) 0) with 5-step delay (d = 5). The 
initial state of the physical system po is given by B /^dO) (0|). The ensemble average over these 
realizations corresponds to the thick red curve; (Second plot) The Frobenius distance between 
the estimator p™' and p (y^Tr ((p — p"''')^)) for 100 realizations. The ensemble average over 
these realizations corresponds to the thick red curve. 
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feedback control. Indeed, the feedback law ak depends only on the historic of the quantum 
jumps as well as the initialization of the quantum filter /3q'. Therefore, we can write 

/3fc,d = ak-d = a{pQ\ So, ... , Sk-d-i), 

where {sj} "q denotes the sequence of k first jumps. Finally, through simple computations, 
we have 

E(Tr(pfep) \po,pT)= Y. 

St 

where 

MsP = MspMl 

So, we easily have the linearity of E (Tr (pkp) \ Po, Pq^^) with respect to po. 

At this point, we apply the assumption kerpg' C kerpo and therefore, one can find a 
constant 7 > and a well-defined density matrix p^ in X, such that 

pT = 7P0 + (1 - 7)Po- 

Now, considering the system (21) initialized at the state {p^^^^^, Pq^,0, ... ,0), we have by the 
assumptions of the theorem and applying dominated convergence theorem: 

limE(Tr(pfcp) \ p^o'\ p^^') = 1. 

fe— >oo 

By the linearity of E (Tr (pkp) \ Po, Pq^) with respect to po, we have 

E (Tr (pkp) I pT, pT) = 7E (Tr (p^p) \ po, pT) + (1 " iW (Tr (pkp) \ p'o, pT) , 

and as both E (Tr (pkp) \ Po, Po^) and E (Tr (pkp) \ Pq, Pq^) are less than or equal to one, we 
necessarily have that both of them converge to 1: 

lim E{TT{pkp) I /5o,/Oo") = l- 

This implies the almost sure convergence of the physical system towards the pure state p. D 

5.3 Local convergence rate for the quantum filter 

Let us linearize the system-observer dynamics (21) around the equilibrium state 
E = {p,p,0,...,0). Set H = H + (5H with 6E = {6p, (^p°"' ,d(3i, . . . ,6Pd) smah, 6p and dp"'' Her- 
mitian and of trace 0. We have the following dynamics for the linearized system (adaptation 
of (17)): 

Spk+i = As, (Spk + <5/3rf,fe[at, p] - 5/3* Ja, p]) Al - Tr {A^Jp^Al) p 
ipT+i = As, [spT + 5Pd.k[^\p\ - SPIA^. p]) Al - Tr (A,,<5pf Aj J p 
J/3i,fe+i =-e(2n+l)(^^t,cos^79J/3,-fc)+ecos'^79Tr(5pf[a,p]) (22) 



5Pd,k+i = <5/3d_ 



l,k 



where s^ G {ffjc}, the random matrices Ag^ are given by Ag = — 2_ with probability 
Pg = cos^ifn and A^. = -. — ^— with probability P^. = sm^ipn. 
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At this point, we note that by considering 5p}. = dp]^^ — 6pk, we have the fohowing simple 
dynamics: 

Spk+i = AsJpkAl^ - Tr [AsJPkAl) p. 



Indeed, as the same control laws are applied to the quantum filter and the physical system, 
the difference between dp"/^^ and 5pk follows the same dynamics as the linearized open-loop 
system (8). But, we know by the proposition 1 that this linear system admits strictly negative 
Lyapunov exponents. This triangular structure, together with the convergence rate analysis 
of the closed-loop system in proposition 2, yields the following proposition whose detailed 
proof is left to the reader: 

Proposition 3. Consider the linear Markov chain (22). For small enough e > 0, its largest 
Lyapunov exponent is strictly negative. 

6 Conclusion 

We have analyzed a measurement-based feedback control allowing to stabilize globally and 
deterministically a desired Fock state. In this feedback design, we have taken into account 
the important delay between the measurement process and the feedback injection. This delay 
has been compensated by a stochastic version of a Smith predictor in the quantum filtering 
equation. 

In fact, the measurement process of the experimental setup [I] admits some other im- 
perfections. These imperfections can, essentially, be resumed to the following ones: 1- the 
atom-detector is not fully efficient and it can miss some of the atoms (about 20%); 2- the 
atom-detector is not fault-free and the result of the measurement (atom in the state g or e) 
can be inter-changed (a fault rate of about 10%); 3- the atom preparation process is itself a 
stochastic process following a Poisson law and therefore the measurement pulses can be empty 
of atom (a pulse occupation rate of about 40%). The knowledge of all these rates can help us 
to adapt the quantum filter by taking into account these imperfections. This has been done 
in [6] , by considering the Bayesian law and providing numerical evidence of the efficiency of 
such feedback algorithms assuming all these imperfections. 
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A Stability theory for stochastic processes 

We recall here the Doob's first martingale convergence theorem, the Doob's inequality and the 
Kushner's invariance theorem. For detailed discussions and proofs we refer to [14] (Chapter 
2) and [13] (Sections 8.4 and 8.5). 

The following theorem characterizes the convergence of bounded martingales: 

Theorem 4 (Doob's first martingale convergence theorem). Let {Xn} be a Markov chain on 
state space X and suppose that 

E {Xn) > E {Xm) , forn> m, 

this is Xn is a suhmartingale. Assume furthermore that (x^ is the positive part of x) 

supE(X+) < cx). 

n 

Then lim„X„ (= X^o) exists with probability 1, and E(X+) < oo. 

Now, we recall two results that are often referred as the stochastic versions of the Lyapunov 
stability theory and the LaSalle's invariance principle. 

Theorem 5 (Doob's Inequality). Let {X„} be a Markov chain on state space X. Suppose 
that there is a non-negative function V{x) satisfying E (y(Xi) ] Xq = x) — V{x) = —k{x), 
where k{x) > on the set {s : V{x) < A} = Qx- Then 

P ( sup y(X„) >X\Xo = x)< ^. 

\oo>n>0 / ■^ 

For the statement of the second theorem, we need to use the language of probability mea- 
sures rather than the random processes. Therefore, we deal with the space A4 of probability 
measures on the state space X. Let fiQ = a he the initial probability distribution (every- 
where through this paper we have dealt with the case where fiQ is a Dirac on a state po of 
the state space of density matrices). Then, the probability distribution of Xn, given initial 
distribution a, is to be denoted by Pn{o')- Note that for tti > 0, the Markov property implies: 

Pn+micr) = UnifJ-micr)) . 

Theorem 6 (Kushner's invariance theorem). Consider the same assumptions as that of the 
theorem 5. Let fiQ = a be concentrated on a state xq £ Qx (Qx being defined as in theorem 5), 
i.e. a{xQ) = 1. Assume that < k{Xn) — )• m Qx implies that Xn — )■ {x \ k{x) = 0} n Qx = 
Kx- Under the conditions of theorem 5, for trajectories never leaving Qx, Xn converges to 
Kx almost surely. Also, the associated conditioned probability measures /i„ tend to the largest 
invariant set of measures A^oo C M whose support set is in Kx- Finally, for the trajectories 
never leaving Qx, Xn converges, in probability, to the support set of Moo- 
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B Lyapunov exponents of linear stochastic processes 

Consider a discrete-time linear stochastic system defined on M'^ by 

where Ag,. is a random matrix taking its values inside a finite set {^i, . . . ,^m} with a sta- 
tionary probability distribution for Sk over {1, . . . ,m}. Then 

A(Xo)=limilog(|™), 

for different initial states Xq G M"^, may take at most d values which are called the Lyapunov 
exponents of the linear stochastic system. 
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